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Abstract —This paper proposes a new class of hardware ac¬ 
celerators to alleviate bottlenecks in the acquisition, analytics, 
storage and computation of information carried by wideband 
streaming signals. 

Index Terms —Dispersion modes, time stretch, warped chirp, 
optical hardware accelerator, optical hardware accelerator, ana¬ 
log hardware accelerator, feature extraction, data compression, 
ultrafast acquisition, spectrotemporal reshaping, spectrotempo- 
ral basis functions, spectrotemporal computational primitives, 
spectrotemporal computing, nonlinear spectrotemporal modes, 
analog optical analytics, analog coprocessor. 

1. Introduction 

ARDWARE accelerators are custom digital computing 
engines with successful examples including communi¬ 
cation and media processors 0 0 As opposed to general 
purpose computers that perform a myriad of applications 
specified by the software, hardware accelerators are optimized 
to perform a specific function but do so faster and with less 
power than a general purpose processor. Here we introduce 
the concept of photonic hardware accelerators (PHA) - analog 
real-time optical waveform transformations that alleviate band¬ 
width and sensitivity bottlenecks in acquisition and storage 
of wideband streaming data as well as perform real-time 
analytics and coding. In the context of computing, PHA 
can be viewed as the optical rendition of analog computers 
that appeared in the early days of computing. While analog 
computers were replaced by much more powerful and versatile 
digital computers, the lack of power efficient and scalable 
logic operations in optics makes it unlikely that analog optical 
computing will be replaced by a digital optical counterpart. 

Traditional hardware accelerators (Fig. [T]) are application- 
specific digital signal processing devices designed to perform 
computational operations, such as fast Fourier transform (FFT) 
and video encoding, that would be slow and power hungry 
if performed in software. By doing so, they increase the 
speed and reduce the power dissipation. In contrast, PH As are 
analog optical engines. One type of PHA reduces the envelope 
bandwidth of fast optical data to allow digitization by a much 
lower bandwidth electronic Analog-to-Digital Converter (A/D 
converter or ADC). In doing so, it makes it possible to capture 
and digitally process wideband optical data in real-time. Also, 
by taking advantage of the sparsity in the signal it reduces 
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Fig. 1. Comparison of traditional hardware accelerator with analog and pho¬ 
tonic hardware accelerators (PHA). (a) Traditional hardware accelerators are 
custom digital signal processing devices designed to perform computational 
operations that would be slow and power hungry if performed in software, 
(b) An analog hardware accelerator can be placed before the analog-to-digital 
conversion to take part of the processing burden off of the digital hardware and 
software processing, (c) Photonic hardware accelerators are analog computing 
engines that make it possible to capture and digitally process wideband optical 
data in real-time, (d) Combinations of photonic hardware accelerators and 
electronic analog accelerators as analog coprocessors before the analog-to- 
digital conversion are even more efficient in supplementing the functions of 
the digital processors. 

the amount of data produced in wideband A/D conversion. 
Such an PHA simultaneously addresses two of the main 
bottlenecks in high speed real-time data acquisition, i.e. the 
bandwidth requirement for capturing ultra wideband signals 
and subsequently, storage and management of the large amount 
of data produced by wideband A/D. In one implementation it 
offers data compression, but in an entirely different fashion 
than compressive sensing & 0 and one that is far better 
suited for real-time operation. 

Fig. depicts the concept of the information engineering 
leading to nonuniform sampling of envelope amplitude. Both 
are achieved by transformation of the signal, prior to sam¬ 
pling, using group delay dispersion primitives described in 
the main body of this paper. In Fig. |^, the central idea is a 
reshaping, i.e. a warping of the signal that, upon subsequent 
uniform sampling, causes more samples to be allocated to the 
information-rich portion of the signal than the sparse regions. 
While the concept of nonuniform sampling is not new, what 
is new here is achieving this through reshaping the signal 
followed by uniform sampling, as opposed to using a variable- 
rate sampler (Fig. |^). This approach obviates the need for 
having a dynamically tunable sampler. The same class of 
transformations provides a phase output that is sensitive to 
transitions in the data and offers a means to detect fast rapid 
changes and anomalies (Fig. [^). Analog optical analytics is 
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Fig. 2. Conventional nonuniform sampling vs. the new method for achieving 
the same via spectrotemporal warping followed by uniform sampling, (a) The 
central idea is a reshaping, specifically warping of the signal such that after 
uniform sampling, more samples are allocated in the information-rich (high- 
entropy) portion than the sparse regions, (b) While the concept of nonuniform 
sampling is not new, what is new is achieving this through reshaping the signal 
followed by uniform sampling, as opposed to using a variable-rate sampler, 
(c) The same class of transformations provide a phase output that is sensitive 
to transitions in the data and combined with thresh olding , offer a mean to 
detect fast rapid changes and anomalies (see Section [Tv^ . 


another fortuitous property of proposed dispersive reshaping 
operations. 

The analog processing engine contemplated here may be 
interpreted as an optical information gearbox that matches the 
information rate of the signal to that of the data capture, pro¬ 
cessing, and storage blocks. The benefit can be metaphorically 
visualized in Fig. The figure illustrates the analogy to a 
sparse video where key frames are clustered in time. A video 
consisting of frames uniformly distributed in time results in 
inefficient data representation. It lacks sufficient frame rate to 
capture the key events while producing redundant frames in the 
sparse portions. In digital video compression (such as MPEG), 
this problem is solved by interframe compression, where for 
most frames, the encoder only saves the change with respect 
to the prior frame 0- The challenge and one that we 
address here is how to perform similar compression on analog 
signals in real-time and at the speed of light. 

The transformations discussed in this paper, exploit signal 
sparsity to achieve: (1) warped Fourier domain compres¬ 
sion, (2) enhance the analog signal-to-noise ratio during data 
acquisition, and (3) perform analytics. The operations are 
performed using filters with large and reconfigurable group 
delay dispersion. Such filters are most readily realizable in 
optics because of availability of wideband, low loss, and 
reconfigurable dispersive elements. In discussions that follow 
we assume information is already in the optical domain, or 
has been modulated onto an optical carrier. We will not 
be concerned with how the data is generated and about 
the electro-optic conversion process. While the focus of the 
present paper is on analog signals, the processes can be 
emulated in discrete domains and numerically applied to 
digital data as discussed in Section |IV-I[ These represent a 
new class of digital signal processing algorithms that are 


inspired by the physics of dispersive propagation of temporal 
signals, and diffractive propagation of images, through media 
with specifically designed curved (nonlinear) dispersion and 
diffraction properties. 

II. Mathematical Framework 

Let’s consider operating on a signal with a phase filter 
described by the transfer function 

H{uj) = ex.p[i(t){uj)] (1) 

where (/)(cc) is an arbitrary function of frequency, cc, and its 
range can be significantly larger than 27r. The phase can be 
expanded in terms of basis functions (or modes), 

-\-oo 

= L] (2) 

m=0 

The transfer function is a phase operator, which can be viewed 
as a cascade of mode operators, Ff^(co’): 

4-00 4-00 

H{co)= = II exp[i</>„(w)] (3) 

m=0 m=0 

The basis functions can be polynomials or other suitable 
functions as discussed later. In the case of polynomials, basis 
functions take the form of powers of uj and can be expressed 
in terms of the Taylor expansion: 

(him) 

= -j-(w - Wc)™ (4) 

ml 

dw™ 

where is the mth derivative of phase with respect to 

frequency evaluated at the carrier frequency, ujc. By definition, 
the modulation sideband frequency is = uj — uJc- 

Within this framework, the filter group delay, r(ci;), is given 
by 

d0(cj) ^ 

^ duj ^ ^ ^m(^) (6) 

m=l 

For the case of polynomial basis functions, the group delay 
modes become, 

(him) 

Tmioj) = - - - Wc)™ (7) 

[m — 1)! 

Similarly, T“^(r) are the chirp modes of mth order. 

Upon propagation itoough the filter, an envelope modulated 
pulse with spectrum Eiioj — ujc) is transformed into a temporal 
signal with an envelope given by, 

1 ^ 

J — oo 

The integral can be solved using the stationary phase approxi¬ 
mation. The approximation assumes that the input spectrum is 
a slowly varying function while the exponential in the integral 
varies rapidly. The latter is satisfied when filter group delay is 
relatively large leading to the far field regime of dispersion. 


( 5 ) 
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Fig. 3. Metaphorical visualization of the benefit offered by nonuniform sampling that exploits sparsity in the data. A video consisting of frames uniformly 
distributed in time lacks sufficient frame rate to capture the key event while produces redundant frames in the sparse portions. In the proposed systems, 
nonuniform sampling is achieved by warping the signal prior to uniform sampling. 


Under this condition, the spectrum is mapped into time, with 
the mapping relation 


+ 00 


■(‘-) = E 




(to - 1) 


■(cu - CUc) 


m —1 


( 9 ) 


The m = 1 term is a time shift corresponding to the latency 
through the filter. The m = 2 term describes linear frequency 
to time mapping meaning that at any time t, only a distinct 
frequency contributes to the temporal envelope at that time. 
Hence the output temporal envelope is a replica of the optical 
spectrum, i.e. the system performs Fourier transformation. 
Fourier domain sampling is then achieved by simply sampling 
the dispersed temporal envelope. A powerful feature of this 
type of transformation is the time-stretch causing temporal 
envelope to be made arbitrarily slow such that the spectrum 
can be digitized in real-time by an analog-to-digital converter. 

The m = 2 mode can be identified as the classic Time- 
Stretch Dispersive Fourier Transform (TS-DFT), a power¬ 
ful technique with early application in wideband analog-to- 
digital conversion and spectroscopy ||^. Described as 
“slow motion at the speed of light,” TS-DFT has since led 
to the discovery of optical rogue waves | [T0|, world record 
performance in analog-to-digital conversion |11|, the creation 
of a new imaging modality known as the time stretch camera 
GD-Qt), which has enabled detection of cancer cells in blood 
with record sensitivity |T^- (2D, and a portfolio of other fast 
real-time instruments such as ultrafast vibrometric imagers 
-p 5 |. For a review of this technique please see reference 

Higher order terms in (|^ describe nonlinear, i.e. warped, 
mapping between frequency and time. Such a system with high 
enough dispersion (called far-field range) can be interpreted 
as performing warped Fourier transform. As will show, to 
achieve nonuniform Fourier domain sampling albeit using a 
uniform time domain sampler, the warp profile must be chosen 
according to the spectrotemporal sparsity of the signal. 

It is important to note that the precise one-to-one mapping 


— 

26 


of frequency to time, suggested by is not exact; it is subject 
to the accuracy of the stationary phase approximation, i.e. the 
degree to which we are in the far field of dispersion. In reality, 
not a single but rather a finite range of frequencies survives 
the integral in ^ and appear at a given time instance, t. The 
range is centered at frequency described by © and with a 
width given by 


SuJm. — 




47 r 


-Foo , , . 

m=2 


■ UJ, 
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( 10 ) 


The parameter SuJm can be interpreted as the frequency 
resolution, or the ambiguity, in the frequency to time mapping 
relation. can be obtained from the first zero crossings of 
the real and imaginary parts of 

For the case where the group delay is linear, (i.e. when 
0(m) _ Q m > 3 ) the filter performs an inverse Fourier 
transform and the classic linear mapping of spectrum into time. 
For higher order modes, the operation is a nonuniform warped 
mapping in which the strength and shape of the curve can 
be reconfigured through the amplitude and sign of for 
m > 3 . One application for this is warped time stretch where a 
broadband waveform that is short in time is stretched making 
real-time digitization possible. At the same time, the amplitude 
of the time stretched waveform is the warped spectrum of the 
input waveform’s envelope. The shape of the warp is dictated 
by the group delay of the filter, which in turn is prescribed 
by the input signal sparsity. As shown below, time-bandwidth 
compression can be achieved by designing the group delay 
such that it is matched to the time-frequency sparsity of the 
input. This function can be described as warped slow motion 
where the degree to which the signal is slowed down matches 
the information content in the signal spectrum. 


A. Alternative Basis Functions 

A drawback of polynomial basis functions is that to locally 
design the group delay function for each region of the spec- 
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trum requires a large number of modes. One can overcome 
this limitation by using spline functions where the spectrum 
is divided into regions and a different polynomial used in each 
region. In addition, one can employ other localized functions 
such as Gaussian, sigmoids, and wavelets. The basis functions 
can also be a set of pseudorandom dispersion modes. Such 
pseudorandom spectrotemporal basis functions will be useful 
for signals with unknown spectral sparsity pattern. 

The applied group delay dispersion chirps the input wave¬ 
form with a specific profile. Any chirp in the input signal 
will affect the outcome and must therefore be accounted in 
the design of the group delay. The group delay profile should 
correspond to the difference between the desired chirp and the 
chirp of the input signal. 

B. Properties of Phase and Group Delay Dispersion Modes 

Here we consider basis functions fmi^) in <0 and group 
delay modes r^(u;) in 0 as constituent modes of phase 
and group delay functions, and their corresponding temporal 
and spectral transformations as dispersive stretch primitives. 
Modes with m > 3 describe warped group delays and hence 
represent warped stretch primitives. When applied to pulsed 
waveforms, these modes are localized in time and can be 
identified as spectrotemporal stretch wavelets. 

Fig. 1^ shows the phase mode (column 1), group 

delay mode (column 2) Tm{^), and group delay dispersion 
mode (column 3) for seven lowest order modes (m = 0 

to 6). The Figure also shows the transformations they perform, 
in subsequent columns. Columns 4 and 5 are the time domain, 
E{t), and spectrum, E{uj), of the complex passband signal 
envelope. Columns 6 and 7 are the same for the modulus 
squared of the complex amplitude, i.e. the power of the com¬ 
plex signal. For an optical signal this would be proportional 
to the photocurrent, hence column 6 and 7 are labeled as /(t), 
and I{uj). 

The m = 0 mode is a constant phase (zero group delay), 
which has no infiuence on the signal envelope. Hence columns 
1 and 2, in the m = 0 row, are the temporal envelope and the 
envelope spectrum of the input signal under test. 

The m = 1 mode is the linear phase (constant group 
delay) operation. Its effect on the signal is simply a constant 
time shift (latency) of the envelope with no change in the 
envelope spectrum. The m = 2 mode is the linear group delay 
performing the TS-DFT operation. The spectrum is linearly 
mapped into time resulting in a stretched temporal waveform 
that is a replica of the spectrum. 

The m = 3 mode as well as higher odd order modes are 
characterized by a group delay that is symmetric about the 
carrier frequency, and a phase that is antisymmetric. Upper 
and lower sidebands experience the same group delay causing 
folding of the spectrum concurrent with spectrum to time 
mapping. The mapping has even symmetry, with respect to 
group delay (odd with respect to group delay dispersion). 

The m = 4 and higher even order modes describe nonlinear 
mapping of spectrum into time and warped stretch trans¬ 
formation. These modes exhibit preferentially higher group 
delay at the wings of the spectrum (away from the carrier 


frequency). The frequency to time mapping has odd symmetry 
and stretching in time is warped and occurs primarily at the 
wings. More complex warp structures can be synthesized by 
combining the m = 2 (linear group delay) mode and higher 
even order modes with proper sign and amplitude as discussed 
below. Although phase modes linearly superimpose to form a 
desired group delay profile, the output envelope is not a linear 
superposition of the output envelopes of each mode. This is 
due to the nonlinear relationship between phase modes and 
output envelopes. 

These phase and group delay operations have other utili¬ 
ties beyond warped Fourier domain sampling. By virtue of 
applying an engineered chirp to the signal, they can be used 
to manipulate particular regions of the frequency spectrum. 
Dispersion modes and stretch wavelets can be viewed as a 
special class of eigenmodes and wavefunctions. As shown 
below, the distinct symmetry of dispersion eigenfunctions 
determines their signal processing property. The modes can 
also be viewed as dispersion primitives from which complex 
dispersion operations can be synthesized. While polynomial 
functions are not universally orthogonal, we can envision 
other expansion, and certain classes of polynomials, that are 
orthogonal. 

C. Spectrotemporal Sparsity 

The traditional notion of sparsity, i.e. sparsity in time, is 
not pertinent here. Instead, sparsity (entropy) in the spectrum 
is the attribute that infiuences and guides the design of the 
filter’s group delay profile. To show the connection between 
the group delay and the signal sparsity and as a design and 
visualization tool, we introduce the concept of spectrotemporal 
sparsity. 

Let us consider, as an example, an optical signal whose input 
temporal envelope (baseband) and its spectrum are shown 
in Fig. and Fig. |^, respectively. Fig. then shows the 
local (short-time) Fourier transform of the spectrum. In other 
words, it is equivalent to viewing the spectrum as a temporal 
waveform and plotting its short time Fourier transform. As 
a result, the horizontal axis is the input frequency and the 
vertical axis is the local frequency of variations in the spectrum 
magnitude. We call this the frequency of spectrum. In this 
example, input signal spectrum (Fig. |^) is feature dense (has 
high entropy) in the central region and feature sparse (has 
low entropy) in the wings. Hence, the local frequency is high 
in the central region and low in the wings (Fig. [^). While 
this is only one example, in the Applications section of this 
paper, we show a powerful optical imaging system in which 
the signal has this specific type of sparsity (Section |IV-B| ). 
The desired group delay must conform to the local frequency, 
shown in Fig.[^. In the regions where the spectrum magnitude 
has fast variations, the filter (Fig. |^) presents a high group 
delay dispersion (slope) resulting in larger stretching in time 
than the slow varying regions of the spectrum magnitude. The 
frequency-to-time mapping and temporal stretching are warped 
in such a manner that the sparse wings of the spectrum are 
squeezed relative to the dense central region (Fig. |^). The 
low entropy wings are squeezed in so that they occupy a 
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Fig. 4. Dispersive phase (column I), group delay (column 2) and group delay dispersion (column 3) modes for the 7 lowest order dispersion modes. The 
figure also shows the stretch operations performed by these modes. Columns 4 and 5 are the time domain, E(t), and spectrum, E(uj) of the complex passband 
signal envelope. Columns 6 and 7 are the same for the square of the magnitude, i.e. the power of the complex signal. For an optical signal this would be 
proportional to the photocurrent, hence column 6 and 7 are labeled as I(t), and /(cu). The m = 0 mode is a constant phase (zero group delay) which has no 
influence on the signal, so the output envelope is same as that of the input signal. The m = 1 mode is the linear phase (constant group delay) operation. Its 
effect on the signal is simply a constant time shift (latency) with no change in the spectrum magnitude. The m = 2 mode is the linear group delay performing 
the Time-Stretch Dispersive Fourier Transform (TS-DFT) operation. The m = 3 mode as well as higher odd order modes are characterized by a group delay 
that is symmetric about the carrier frequency and cause folding of the spectrum during spectrum to time mapping. The m = A and higher even order modes 
describe nonlinear mappings of spectrum into time and warped stretch transformations. 
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shorter time duration after the warped stretch. The resulting 
restructuring of the spectrotemporal distribution is shown in 

Fig. 15. 

Upon uniform sampling of the output envelope, the nonuni¬ 
form mapping and warped stretch cause the dense portion of 
the spectrum to effectively receive higher sampling resolution 
than the sparse regions leading to nonuniform sampling. The 
sampling rate is basically matched to the signal’s spectrum 
sparsity. We note that this nonuniform sampling is performed 
not by a variable rate sampler, but with a uniform sampler 
preceded by warped spectrotemporal reshaping. To be sure, a 
variable rate sampler is a device that is exceedingly difficult 
to realize as it would have to dynamically adapt its sampling 
rate to the signal in real-time. 


D. Complex Spectrotemporal Synthesis 

More complex group delay and stretch profiles, than those 
shown in Fig. can be synthesized using the mode library 
described in Fig. Three examples are shown in Fig. 

In each case, the group delay profile is governed by the 
spectrotemporal sparsity of the input waveform. Fig.|^ depicts 
three possible types of spectrotemporal distributions of the 
input signal spectrum. Fig. shows the corresponding filter 
group delay that matches the sparsity in each case. The 
asymptotic dashed lines show the group delay dispersion, 
i.e. the slope of the group delay. In the sparse regions, the 
group delay dispersion is smaller resulting in a more compact 
mapping into time. Conversely, the dense portions of the 
spectrum experience a larger dispersion and are stretched 
into a longer time scale. Once again, upon uniform sampling 
and dewarping of the output envelope, the operation leads to 
nonuniform sampling of the input spectrum (Fig. |^). 


III. Optical Implementations and 
Reconfigurability 

Such signal transformations require phase filters with large 
group delays. Optical fibers and waveguides provide a practical 
method for implementing such filters in the optical domain. 
While optics suffers from lack of efficient electro-optical and 
optical-optical interactions necessary for switching and logic, 
it does offer well known virtues of low loss and wideband 
operation. What is less appreciated, and one that is relevant 
to the present discussion, is its temporal dispersion property 
offering nanoseconds of differential group delay over tens of 
terahertz of bandwidth, metrics that are unimaginable in the 
realm of electronics. 

Temporal dispersion in optical domain, otherwise known 
as group delay dispersion, describes the dependence of the 
propagation constant on frequency. The dependence originates 
from the spectrum of the material’s refractive index and from 
that of the propagation constant of the guided mode. In 
frequency domain, dispersion manifests itself as a phase filter 
with transfer function given by the operator ^ and with the 


phase, group delay, and group delay dispersion as 

+00 +CO ^ 

ml 

m=0 m=0 

+ 00 +CX) ^ 

^(w)= ^T„(w)= ^ (12) 

m=l m=l 

+00 +00 ^ 

^'M= ^ (13) 

m=2 m=2 ^ ' 

where pm is the mth order dispersion parameter. The most 
readily available and commonly used dispersive optical device 
is the optical fiber. Among optical fiber designs, the dispersion 
compensation fibers (DCFs) | [28| is particularly attractive for 
high dispersion and low loss. These fibers are capable of 
producing 100s of picoseconds of group delay dispersion 
per nanometer of optical spectrum (1 nm corresponds to 
125 GHz at the telecommunication wavelength of 1550 nm) 
with a concomitant optical loss of less than 1 dB. With 
addition of internal amplification via the stimulated Raman 
scattering, the dispersion can be extended in excess of 10 
ns/nm p9|- (3T| (Fig. |7ji). Other attractive options are the 
chirped fiber Bragg gratings (CFBGs) (Fig.[^) the 

ChromoModal Dispersion (CMD) device (Fig. |34| , and 
the reconfigurable optical add-drop multiplexers (ROADMs) 



The CFBG is a distributed Bragg refiector (periodic vari¬ 
ation in the refractive index) written in a short segment of 
an optical fiber that reflects particular wavelengths of light 
and transmits all others (Fig. [^) p2| . The refractive index 
periodicity is chirped so that different wavelengths refiected 
from the grating undergo different time delays. When com¬ 
bined with a circulator as shown in Fig. |^, the device offers 
large group delays of several nanoseconds per nanometer 
but over a smaller wavelength range than the optical fiber. 
The advantages over fibers are its short length and ability to 
customize the amount of group delay magnitude and profile at 
the time of device fabrication. The main disadvantage is group- 
velocity ripples that are converted to fast temporal modulations 
after frequency-to-time mapping p3| . 

The CMD is a type of dispersive device that converts the 
large modal (spatial) dispersion inherent in multi-mode fibers 
or waveguide to chromatic (frequency dependent) dispersion 
(Fig. 1^) p4| . It does so by combining the waveguide with 
a diffraction grating. Angularly dispersed broadband light is 
focused onto a multi-mode fiber coupling various spectral 
components into distinct fiber modes each having a different 
phase velocity. The strength, sign, and the delay vs. frequency 
curvature can be widely reconfigured by adjusting the align¬ 
ment of the grating and the waveguide. The CMD device 
provides field reconfigurable tuning of the group delay and 
offers a means to achieve the type of phase filters needed for 
engineering the spectrotemporal structure of wideband optical 
waveforms in a reconfigurable fashion. Also recently, linear-to- 
curved space mapping is combined with the CMD to achieve a 
new dispersive device that offers arbitrary tuning of dispersion 
curvature p7| (Fig. [^. 

The ROADM is a tunable wavelength-division multiplexing 
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Fig. 5. Introducing the concept of spectrotemporal sparsity, (a) Input temporal envelope and (b) magnitude of the spectrum, (c) Local (short-time) Fourier 
transform of the spectrum magnitude, (d) The warped group delay dispersion used to reshape the envelope. Frequency-to-time mapping and temporal stretching 
are warped in such a manner that the sparse wings, i.e. the peripheral regions of the spectrum, are squeezed relative to the dense central region, (e) The sparse 
wings now occupy a shorter time duration leading to efficient sampling, (f) The output shows reshaped spectrotemporal distribution with energy compressed 
in the central region. 
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Fig. 6. (a) The first column shows three possible types of spectrotemporal distribution of the input signal envelope, (b) The middle column is the corresponding 
group delay that matches the sparsity in each case, (c) The last column shows what effectively happens when the warped signal is sampled uniformly. A 
lower sampling rate is effectively applied to the sparse regions and higher rate to the dense regions of the spectrum with the use of a constant rate sampler. 


filter with a channel monitor and attenuator/amplifier that 
can be remotely reprogrammed to change the channel access. 
Having a wavelength selective switch, they can be used in 
parallel in conjunction with a set of tunable delays to form 
a quantized form of the group delay profile. As long as the 
spectral resolution of the channels in the ROADM is fine 
enough for the target application, this can be an effective 
approach to implement an easily reconfigurable arbitrary group 
delay profile. 


IV. Applications 

A. Nonuniform Fourier Domain Sampling: Exploiting Sparsity 

The Fast Fourier Transform (FFT) algorithm is arguably 
one of the most important and practical technologies in use 
today. By making Fourier transform computationally efficient, 
it has become the bedrock of digital signal processing for 
communication and image processing. Nevertheless, FFT has 
some limitations. First, real-time operation at micro- and 
nanosecond time intervals is still difficult for large block sizes. 
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Fig. 7. Various method for realizing optical dispersion, (a) Dispersive optical fiber with internal Raman amplification, (b) Chirped Fiber Bragg Grating 
(CFBG) used in conjunction with a circulator, (c) Chromo-Modal Dispersion (CMD); The CMD device offers field reconfigurability of phase and group delay 
dispersion through tuning of the launch angle of light into the multi-mode waveguide. 
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Fig. 8. (a) Schematic of the curved space mapping chromo-modal dispersion device (CMD device) and the functions it performs (inset), (b) Warping of 

spatial dispersion by a parabolic mirror. Diagrams on the right hand side show, from top to bottom, the mapping of optical frequency into one-dimensional 
(ID) space, two-dimensional (2D) space, and ID polar coordinate space (Tt] . 


Second, application of FFT to optical data is restricted due 
to the ultra-wideband nature of optical data and the inability 
to digitize such broadband signals with an analog-to-digital 
converter. Third, FFT expands the signal into a linearly spaced 
basis set and this leads to a Fourier domain representation 
that is larger than necessary when the input signal spectrum 
is sparse. In fast real-time operations, this creates a big data 
predicament via a generation of redundant data. 

The TS-DFT addresses the real-time operation and the ADC 
bottleneck. By mapping the spectrum into a time domain 


waveform that has been slowed enough to be digitized in real¬ 
time, it enables fast Fourier transformation and digitization of 
wideband optical signals as if it is the FFT of optics. TS-DFT 
has been used to create instruments that measure extremely 
fast optical waveforms at high throughput by measuring their 
Fourier spectrum as opposed to directly measuring their tem¬ 
poral profile. 
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Illumination & Imaging Optics 


Microfluidic 

Device 



Time-stretch Dispersive Fourier Transform (TS-DFT) 
plus real-time image processing 


Fig. 9. Time stretch camera. The camera first captures fast sequential line- 
scans with laser pulses that are fashioned into ID rainbows. This encodes 
the ID image into the spectrum of the laser pulse. A 2D image is obtained 
when subsequent pulses capture line-scans along the direction of motion of 
cell within a microfluidic flow channel. Back-reflected pulses from the flow 
channel are directed via an optical circulator toward a dispersive element 
with linear group delay (quadratic phase) so that they can be digitized and 
processed in real-time. During the dispersive time stretch, images are also 
optically amplified to overcome the thermal noise inherent in optoelectronic 
conversion. 


B. Case Study: Big Data Predicament in Biological Cell 
Screening 

Fast real-time instruments inevitably create a big data prob¬ 
lem. As a case study that highlights the big data predica¬ 
ment in the context of imaging, we consider the time-stretch 
microscopy system, shown in Fig. for analysis of blood 
cells in high-speed flow. The camera takes blur-free images of 
fast-flowing particles in the microfluidic device. The acquired 
images are optoelectronically processed and screened in the 
real-time optoelectronic image processor that employs the TS- 
DFT. 

The camera first captures fast sequential line-scans with 
laser pulses that are fashioned into ID rainbows. This encodes 
the ID image into the spectrum of the laser pulses. A 2D image 
is obtained when subsequent pulses capture line-scans along 
the direction of cell flow within a microfluidic channel. Back- 
reflected pulses from the microfluidic channel are directed via 
an optical circulator toward a dispersive element with linear 
group delay (quadratic phase) so that they can be digitized 
and processed in real-time. During the dispersive time stretch, 
images are also optically amplified to overcome the thermal 
noise inherent in optoelectronic conversion. It is also important 
to note that the stretched pulse duration (determined by the 
maximum group delay over the optical bandwidth) must be 
less than the laser repetition period. Hence, for a given laser 
repetition rate and a large bandwidth, there is an upper limit 
on the amount of group delay. 

The time stretch imager captures up to one billion line- 
scans per second | [3^ , p^ . Such high throughput operation 
is ideal for identifying rare abnormal cells in blood |T8|-|[2Q| . 
Indeed the system was successful in detecting breast cancer 
cells in blood with less than one-in-a-million specificity error. 



Fig. 10. An example where the proposed spectrotemporal reshaping leads to 
efficient sampling, (a) In the STEAM system, spectrum is linearly mapped into 
time using a dispersive optical fiber with a linear group delay. The temporal 
waveform is then sampled by a digitizer resulting in uniform spatial sampling, 
(b) This uniform sampling generates superfluous data by oversampling the 
sparse peripheral sections of the held of view, (b) The same problem exists 
in the human vision where high sampling resolution is needed in the central 
vision while coarse resolution can be tolerated in the peripheral vision, (c) 
By using nonlinear spectrotemporal mapping via a properly warped group 
delay the desired nonuniform sampling of the line image is achieved causing 
efficient allocation of samples to the information-rich regions of the held 
of view. The reconstruction is a simple dewarping using the inverse of the 
group delay profile, (d) This process is analogues to image reconstruction in 
anamorphic art. 


roughly 100 times better than the standard blood analyzer. Pro¬ 
ducing data at a rate of approximately 100 Gbps, the massive 
throughput of such a system creates a big data predicament 
that challenges even the most advanced acquisition and storage 
technologies. 

Fig, illustrates the big data problem in imaging. The held 
of view consists of a cell against a background such as a flow 
channel or a microscope slide. Illumination by an optical pulse 
that is diffracted into a ID rainbow maps the ID space into 
the optical spectrum (Fig. \T^). In the time stretch camera 
(STEAM), spectrum is linearly mapped into time using a 
dispersive optical fiber with a linear group delay. The temporal 
waveform is then sampled by a digitizer resulting in uniform 
spatial sampling. This uniform sampling generates superfluous 
data by oversampling the sparse peripheral sections of the 
held of view, which do not contain significant amounts of 
information. The same problem exists in the human vision 
where high sampling resolution is needed in the central vision 
while coarse resolution can be tolerated in the peripheral 
vision (Fig. 10b). In nature, this is solved by nonuniform 
photoreceptor density in the retina. The fovea section of the 
retina has a much higher density of photoreceptors than the 
rest of the retina and is responsible for the high resolution of 
central vision necessary for activities where visual detail is of 
primary importance, such as reading. 

We can emulate functionality of the fovea by using nonlin¬ 
ear mapping of spectrum into time via a warped group delay 
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Fig. II. Spectrotemporal reshaping leads to the engineering of the signal to 
noise ratio of an analog signal. Dashed line shows an arbitrary input signal 
transformed via the m = 2 mode (linear group delay) and same with the 
warped group delay in Fig. which is synthesized via superposition of this 
mode with higher order even modes (solid line). By concentrating the energy 
over a shorter time duration, the warped waveform has a higher instantaneous 
power. 


shown in Fig.|^ |[40|-|[43|. This leads to the desired nonuni¬ 


form sampling of the image line-scans depicted in Fig. 10 


causing efficient allocation of samples to the information-rich 
regions of the field of view. The reconstruction is a simple 
dewarping using the inverse of the group delay. This operation 
is analogous to the anamorphic art, where the drawn shape 
is a stretched and warped version of the true object, yet, the 
viewer sees the true object upon reflection of the painting from 
a curved mirror (Fig. p^). 


C. Signal-to-Noise Ratio Enhancement 

The warped group delay operations described here modify 
the spectrotemporal distributions. These modifications can be 
viewed as changes in the time duration, the bandwidth, and 
consequently the time-bandwidth product of the envelope as 
observed in Fig. By using proper curvature for the group 
delay dispersion profile, the envelope time-bandwidth product 
can be compressed or expanded subject to the sparsity of the 
signal | [44| , | [45| . 

Here we show for the first time that for sparse analog 
signals spectrotemporal reshaping can lead to engineering and 
improvement of the signal-to-noise ratio (SNR). Note that the 
SNR enhancement is always relative to the linear dispersion; 
one can never enhance SNR beyond that of the initial input 
signal. Also, the improvement is subject to the signal having 
the proper sparsity such that it can be compressed as discussed 
previously. Fig. 11 (dashed line) shows an arbitrary input 
signal transformed via the m = 2 mode (linear group delay) 
and same with the nonlinear group delay in Fig. [^, which is 
synthesized via superposition of this mode with higher order 
even modes (solid line). By concentrating the energy over 
a shorter time duration, the warped waveform has a higher 
instantaneous power. 

Let the average envelope time stretch factor be M, and its 
average bandwidth compression factor be N. In the case of 
a linear group delay (m = 2) the time-bandwidth product 
(TBP) is conserved, therefore N = M. In the case where it is 
compressed N > M, and in case of expansion, N < M. 
We approximate our system as an adiabatic one, meaning 
there are no extrinsic energy losses. This is consistent with 


the fact that optical fibers and fiber based devices that are 
used to perform the stretch operations have vanishingly low 
loss. We also assume that the input signal is transform-limited, 
i.e. it has no chirp. If the input is chirped, the filter group 
delay profile should be the difference between the desired 
spectrotemporal chirp and the chirp of the input signal. In 
the following discussion, signal power and noise refer to the 
average values over the signal duration. 

Upon stretching the waveform’s envelope, the average op¬ 
tical power, and the photocurrent, /, are reduced by 1/M. 
The electrical power is reduced as 1/M^. Let us consider the 
impact of TBP compression or expansion on different noise 
sources including thermal noise, shot noise, and amplified 
spontaneous emission noise of optical amplifiers. The analysis 
below assumes white noise or at least a noise power spectral 
density that is white over the envelope bandwidth. 

1) Thermal Noise: The variance of thermal noise current 

AkT 

(i?,) = (14) 

where R is the output resistance and B is the electrical 
bandwidth. Upon spectrotemporal reshaping, the bandwidth 
is reduced to B/N. Because of the relaxed bandwidth, for a 
given load capacitance, C, the RC time constant can now be 
increased proportionally. Increasing the load resistance R by 
N leads to a 1/A^^ total reduction in thermal noise variance. 
Therefore the thermal noise limited signal-to-noise ratio 
(SNR) is scaled by the factor {I/M‘^)/{I/N‘^) = {N/Mf. 
For TBP compression, i.e. when M < N, SNR is increased 
by whereas it is reduced by the same factor for case 

of TBP expansion, M > N. 

2) Shot Noise: The variance of shot noise current is 

(4) = 2IqB (15) 

where I is the average photocurrent, and q is the electron 
charge. Upon spectrotemporal operation, power is reduced by 
M, and bandwidth is reduced by N. Hence the shot noise 
variance is reduced by MN. Therefore SNR is scaled by 
the factor (1/M^)/(1/M- A^) = N/M. For TBP compression, 
i.e. when M < N, SNR is increased by N/M, whereas it is 
reduced for expansion when M > N. 

3) Amplified Spontaneous Emission (ASE) Noise: In optical 
systems that employ optical amplification, the SNR is often 
limited by the amplified spontaneous emission noise and in 
particular, by the beating of this noise with the signal within 
the square-law photodetector. The so-called ASE-signal beat 
noise has a similar behavior to the shot noise and is added to 
it. The variance of the noise current is then 

{fASE) = 2{GI)qB + AuSase{GI)B (16) 

where Vd = q/ho is the photodetector responsivity, ho is the 
photon energy, G is the gain of the optical amplifier, Sase = 
nspho{G — l) is the power spectral density of ASE, and Ugp > 
1 is the population inversion factor, a parameter that describes 
how well the requisite population inversion in gain medium 
has been reached. 

As can be seen, the ASE-signal beat noise variance is 
linearly proportional to the average photocurrent and to the 
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TABLE I 

Impact of Time-bandwidth Engineering on the Electrical SNR. 



TBP constant 

M = N 

TBP compressed 
M < N 

TBP expanded 
M > N 

Thermal noise 

No 

Increased by 

Reduced by 

limited SNR 

change 

(N/M)^ 

(N/M)^ 

Shot noise 

No 

Increased by 

Reduced by 

limited SNR 

change 

N/M 

N/M 

ASE noise 

No 

Increased by 

Reduced by 

limited SNR 

change 

N/M 

N/M 


The impact on optical SNR is the same as the electrical SNR listed 
but to the power 1/2. TBP: time-bandwidth product; M: envelope 
time stretch ratio; N\ envelope bandwidth compression ratio. Average 
compression and expansion over the envelope duration and bandwidth 
are considered. Note that the SNR enhancement is always relative to 
the linear dispersion; one can never enhance SNR beyond that of the 
initial input signal. Results also refer to average SNR over duration and 
spectrum. Also, the improvement is subject to the signal having the 
proper sparsity such that it can be compressed as discussed previously. 

The analysis assumes white noise power spectral density or at least one 
that is white over the envelope bandwidth. 

bandwidth, therefore it is similar to the shot noise case. The 
SNR will be scaled as N/M similar to the case of shot noise. 
Table H summarizes the above obtained results. 

D. Loss in Signal Reconstruction 

We now make an important remark about the ability to 
reconstruct the signal whose time-bandwidth product has been 
engineered. For any time-limited pulse such as the pulses 
analyzed by warped stretch modes, the spectrum is not band- 
limited and the signal reconstruction will suffer from the loss 
of out-of-band spectral components in the acquisition system 
(photodetector and A/D converter). In far field of dispersion, 
the bandwidth limitations imposed by the acquisition system 
can be considered as a frequency-dependent effective band¬ 
width on the variations of the spectrum (frequency of the 
spectrum). This effective bandwidth interpretation facilitates 
the design of group delay profile for a set of desired signals 
with known spectral characteristics and determines the amount 
of information lost in the time-bandwidth engineering and 
reconstruction process. 

With the appropriate dispersion design, the spectral features 
lost in the process of warped stretch become insignificant, and 
the SNR of the warped stretch is superior to that of the linear 
dispersion. Note that the SNR enhancement is relative to the 
linear dispersion. This is not a problem as the application of 
our method is generally for the ultrashort signals that cannot be 
measured in real-time without the time stretch. If the desired 
information is not only in the magnitude of the spectrum but 
also is in its phase, for both linear and warped group delay 
dispersions, phase retrieval is necessary, and it increases the 
reconstruction loss and degrades the SNR in both cases. 

E. Spectrotemporal Coding 

As another application, we consider using the dispersion 
modes to encode information into intra-pulse spectrotemporal 
characteristics. The group delay dispersion primitives (Fig. 


column 3) induce nonlinear chirp onto a transform limited 
input pulse. The magnitude and shape of the chirp is dictated 
by the group delay dispersion curvature of the specific mode. 
Complex chirp profiles, representing sophisticated codes, can 
be synthesized using superposition of these primitives. The 
decoding will consist of operating on the encoded signal 
with the conjugate of the group delay primitive. This chirp 
engineering and coding via group delay dispersion modes will 
have applications in encryption, secure communication, code 
division multiple access, and signal processing. 

F. Classification and Feature Detection 

These modes and their corresponding stretch wavelets have 
unique properties that are used to synthesize operations that 
are configured for matched response to specific classes of 
signals with distinct spectrotemporal characteristics. In one 
application, a bank of dispersive filters, chosen from a library, 
would be used to probe for presence of specific features of 
interest. When implemented with optical filters, the analog 
nature of this processing ensures real-time operation and low 
power consumption. As discussed below, even-order nonlinear 
dispersion modes reveal edges and sharp features in the data. 
Performed in real-time, feature detection can be used to 
transform the signal into a feature space that is better suited 
and more efficient for signal classification. 

G. Data Compression 

The nonlinear sparse Fourier domain sampling described 
above may be used for data compression. This works when 
some frequencies are more important than others. Important 
frequencies are coded with fine resolution preserving features 
of spectrum at these frequencies. On the other hand, less 
important frequencies are coded with a coarser resolution. Nat¬ 
urally, some of the finer details of less important frequencies 
will be lost in the coding. 

In the above example, the information of interest is en¬ 
coded into the amplitude of the spectrum, therefore a simple 
unwarping of the time-to-spectrum map is sufficient for re¬ 
construction. For a more general case where the information 
is contained in both the amplitude and phase, reconstruction 
requires either coherent detection or recovery of phase from 
amplitude measurements. The input signal is then recovered 
by simulation of back propagation through the dispersive oper¬ 
ator, Generally known as a phase retrieval method, there 
are numerous digital algorithms available for recovering the 
complex amplitude from intensity-only measurements |[46|- 
| [55| . The dependence of the reconstruction accuracy on the 
signal-to-noise ratio of the acquired signal has also been ana¬ 
lyzed p6| . As stated previously, because of noise and limited 
resolution of analog-to-digital converters, the reconstruction 
will never be ideal and therefore, this is a lossy compression 
method. 

H. Continuous-time Processing 

In order to apply the proposed transformation for the 
acquisition and analysis of a continuous-time signal, the signal 
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needs to be segmented into multiple pulse trains using a 
process called virtual time gating | [57| . The pulse trains are 
independently dispersed by linear or warped time stretch 
systems in parallel, and the acquired signals are digitally 
concatenated to reveal the spectral features of the continuous¬ 
time signal as it varies with time. The time duration of the gate 
and the shape of the dispersion profile can be reconfigured for 
application to nonstationary signals. 

/. Digital Implementation and Event Detection for Real-time 
Analytics 

The signal transformations described here can be imple¬ 
mented numerically and applied to digital data. The one¬ 
dimensional temporal data can be generalized to 2D images as 
well as N-dimensional data. In image processing applications, 
optical diffraction takes the place of temporal dispersion of 
the envelope, and the mathematics will be a 2D discrete 
version of the ID continuous case presented above (image 
spectrum is in baseband, therefore a more accurate analogy 
is to baseband carrier-less diffraction). The result will be 
a physics-inspired digital signal processing technique that 
achieves multi-dimensional warped Fourier domain sampling, 
by emulating propagation of electromagnetic waves through 
a diffractive medium with an engineered dielectric function. 
As was done with temporal dispersion here, diffraction can be 
modeled by an all-pass phase filter with specific frequency de¬ 
pendencies characterized by the constituent dispersion modes. 
Numerical implementation also makes it possible to use arbi¬ 
trary dispersion modes and sophisticated spectrotemporal basis 
sets, such as pseudorandom sets, that would be difficult to 
achieve in a physical system. 

The magnitude of the transformed data leads to nonuniform 
Fourier transformation. The phase reveals sharp transitions and 
offers a categorically new method for edge detection in images 
| [58| , | |5^ . Edge detection is used for identifying patterns in 
digital images where brightness or color changes abruptly. 
Applying an edge detection algorithm to an image can be 
used for object detection and classification. It also reduces the 
digital file size while preserving important information, albeit 
data compression is not the main objective in edge detection. 

The same edge function can also be performed on tem¬ 
poral waveforms in analog domain to reveal transitions and 
anomalies in real-time as shown in Fig. This is performed 
by operating on the signal with even-order dispersive modes 
(see Fig. |^. Applications include edge triggering, pattern 
recognition, and event detection. Similar to its use in digital 
image processing | [58| , | [5^ , analog edge detection can be used 
for compression by reducing the data set while preserving 
important information. 

V. Conclusion 

In summary, we have introduced the concepts of photonic 
hardware accelerators and one rendition of them in terms of 
real-time analog information engineering units that are based 
on nonlinear dispersion modes. These modes are basic build¬ 
ing blocks of complex spectrotemporal transformations that 
cause large amounts of nonlinear frequency dependent phase 



Time (a.u.) 

Fig. 12. Detection of transients and edges in a waveform. Here the temporal 
phase of the transformed signal contains information about fast transitions 
and reveals edges and anomalies. An arbitrary temporal waveform as well 
as the phase of the transformed signal clearly showing the ability to identify 
transitions in the waveform. This can be used for edge triggering, pattern 
recognition, and event detection. 

(warped chirp) using curved group delay dispersion. While this 
requirement is difficult to realize in analog electronics over 
broad bandwidth and with low loss, it is readily realized in 
optics using dispersive devices that provide large group delay 
dispersion, low loss, and reconfigurability. The requirements 
are also readily met in the digital (numerical) implementation. 

The inherent nonlinearity (square-law) in the optical to 
electrical conversion is an intrinsic part of the proposed signal 
transformations. In one class of applications, the operation 
leads to warped frequency-to-time mapping. The warp profile 
is matched to the signal’s spectrum sparsity such that, when 
followed by a uniform sampler, the reshaping of the signal 
results in nonuniform Fourier domain sampling with more 
samples allocated to the dense portions of the spectrum 
and fewer to the sparse regions. In another application, the 
operations performed using optical dispersive elements lead 
to compression in time-bandwidth product of an analog signal 
with accompanying improvement in signal-to-noise ratio in 
detection and analog-to-digital conversion. Yet in a different 
implementation the nonlinear dispersion modes can be used for 
spectrotemporal coding, feature detection, and classification. 
We anticipate that further research on concepts of nonlinear 
dispersion modes and photonic hardware accelerator intro¬ 
duced here will lead to additional applications. 
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